Robust and MaxMin Optimization under 
Matroid and Knapsack Uncertainty Sets* 

Anupam Gupta^ Viswanath Nagarajan^ R. Ravi^ 



Abstract 

Consider the following problem: given a set system {U, fl) and an edge-weighted graph G = {U, E) on the 
same universe U, find the set ^ S such that the Steiner tree cost with terminals A is as large as possible — 
"which set in is the most difficult to connect up?" This is an example of a max-min problem: find the set 
A ^VL such that the value of some minimization (covering) problem is as large as possible. 

In this paper, we show that for certain covering problems which admit good deterministic online algorithms, 
we can give good algorithms for max-min optimization when the set system Vl is given by a p-sy stem or knapsack 
constraints or both. This result is similar to results for constrained maximization of submodular functions. 
Although many natural covering problems are not even approximately submodular, we show that one can use 
properties of the online algorithm as a surrogate for submodularity. 

Moreover, we give stronger connections between max-min optimization and two-stage robust optimization, 
and hence give improved algorithms for robust versions of various covering problems, for cases where the 
uncertainty sets are given by p-systems and q knapsacks. 



1 Introduction 

Recent years have seen a considerable body of work on the problem of constrained submodular maximization: 
you are given a universe U of elements, a collection C 2^ of "independent" sets and a submodular function 
/ : 2^ — )• M>o, and the goal is to solve the optimization problem of maximizing / over the "independent" sets: 

max/(5). (Max-/) 

S 

It is a classical result that when / is a linear function and {U, il) is a matroid, the greedy algorithm solves this 
exactly. Furthermore, results from the mid-1970s tell us that even when / is monotone submodular and ([/, 0) 
is a partition matroid, the problem becomes NP-hard, but the greedy algorithm is a -approximation — in fact, 
greedy is a 2-approximation for monotone submodular maximization subject to any matroid constraint. Recent 
results have shed more light on this problem: it is now known that when / is a monotone submodular function and 
([/, fi) is a matroid, there exists a ^j;^ -approximation algorithm. We can remove the constraint of monotonicity, and 
also generalize the constraint substantially: the most general results say that if / is a non-negative submodular 
function, and if is a p-iyi^emj^ then one can approximate Max-/ to within a factor of 0(p); moreover, if Q. is 
the intersection of 0(1) knapsack constraints then one can approximate Max-/ to within a constant factor. 

Given this situation, it is natural to ask: For which broad classes of functions can we approximately solve the Max- 
f problem efficiently? (Say, subject to constraints U that form a p-system, or given by a small number of knapsack 
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constraints, or both.) Clearly this class of functions includes submodular functions. Does this class contain other 
interesting subclasses of functions which are far from being submodular? 

In this paper we consider the case of "max-min optimization": here / is a monotone subadditive function defined 
by a minimization covering problem, a natural subset of all subadditive functions. We show conditions under 
which we can do constrained maximization over such functions /. For example, given a set system ({/, T), define 
the "set cover" function fsc '■ 2^ Z>o> where f{S) is the minimum number of sets from T that cover the 
elements in S. This function fsc is not submodular, and in fact, we can show that there is no submodular function 
g such that g{S) < fsc{S) < a g{S) for sub-polynomial a. (See [Section 6| .) Moreover, note that in general 



we cannot even evaluate fsciS) to better than an 0(logn)-factor in polynomial time. However, our results imply 
maxs'gQ fsc{S) can indeed be approximated well. In fact, the result that one could approximately maximize fsc 
subject to a cardinality constraint was given by Feige et al. |[T^]; our results should be seen as building on their 



ideas. (See also the companion paper [|15|].) 

At a high level, our results imply that if a monotone function / is defined by a (minimization) covering problem, if / 
is subadditive, and if the underlying (minimization) covering problem admits good deterministic online algorithms, 
then there exist good approximation algorithms for Max-/ subject to p-systems and q knapsacks. (All these terms 
will be made formal shortly.) The resulting approximation guarantee for the max-min problem depends on the 
competitive ratio of the online algorithm, and p and q. Moreover, the approximation ratio improves if there is a 
better algorithm for the offline minimization problem, or if there is a better online algorithm for a fractional version 
of the online minimization problem. 

Robust Optimization. Our techniques and results imply approximation algorithms for covering problems in the 
framework of robust optimization as well. In the robust optimization framework, there are two stages of decision 
making. E.g., in a generic robust optimization problem, one is not only given a set system {U, Q), but also an 
inflation pai^ameter A > 1. Then one wants to perform some actions in the first stage, and then given a set ^ G O 
in the second stage, perform another set of actions (which can now depend on A) to minimize 

(cost of first-stage actions) + max A • (cost of second-stage actions) 

subject to the constraint that the two sets of actions "cover" the demand set A £ Q. As an example, in robust set 
cover, one is given another set system {U,T): the allowed actions in the first and second stage are to pick some 
sub-collections Ti and T2 respectively from T, and the notion of "coverage" is that the union of the sets in Ti U J-2 
must contain ^. (If A > 1, actions are costlier in the second stage, and hence there is a natural tension between 
waiting for the identity of A, and over-anticipating in the first stage without any information about A.) 

Note that robust and max-min problems are related, at least in one direction: if A = 1, there is no incentive to 
perform any actions in the first stage, in which case the robust problem degenerates into a max-min optimization 
problem. In this paper, we show a reduction in the other direction as well — if one can solve the max-min problem 
well (and if the covering problem admits a good deterministic online algorithm), then we get an algorithm for the 



robust optimization version of the covering problem as well. The paper of Feige et al. [ IC ] gave the first reduction 
from the robust set-cover problem to the max-min set cover problem, for the special case when = (^) ; this result 
was based on a suitable LP-relaxation. Our reduction extends this in two ways: (a) the constraint sets Q, can now 
be p-systems and q knapsacks, and (b) much more importantly, the reduction now applies not only to set cover, 
but to many sub-additive monotone covering problems (those with deterministic online algorithms, as mentioned 
above). Indeed, it is not clear how to extend the ellipsoid-based reduction of JToj ] even for the Steiner tree problem; 



this was first noted by Khandekar et al. [22]. 



Our Results and Techniques. Our algorithm for the max-min problem is based on the observation that the cost 
of a deterministic online algorithm for the underlying minimization covering problem defining / can be used as 
a sun^ogate for submodulaiity in certain cases; specifically, we show that the greedy algorithm that repeatedly 
picks an element maintaining membership in Q and maximizing the cost of the online algorithm gives us a good 
approximation to the max-min objective function, as long as 17 is a p-system. 

2 



We also show how to reduce the problem of maximizing such a function over the intersection of q knapsacks to 
j^O{i/t ) j-yj^g approximately maximizing the function over a single partition matroid at a loss of a factor of 
q{l + e), or instead to rP^il'^ ) runs of approximately maximizing over a different partiton matroid at a loss of a 
factor of (1 + e) — this reduction is fairly general and is likely to be of interest in other contexts as well. These 
results appear in [Section 3 . 



We then turn to robust optimization. In [Section 4 we show that given a deterministic online algorithm for the 
covering function /, and an approximate max-min optimization algorithm for / over a family Vl, we get an algo- 
rithm for two-stage robust version of the underlying covering problem with uncertainty set — the approximation 
guarantee depends on both the competitive ratio of the online algorithm, as well as the approximation guarantee of 
the max-min problem. 

Note that we can combine this latter reduction (using max-min algorithms to get robust algorithms) with our first 



reduction above (using online algorithms to get max-min algorithms); in [Section 5[ we give a more careful analysis 
that gives a better approximation than that obtained by just naively combining the two theorems together. 



Finally, in Section 6, we show that some common covering problems (vertex cover and set cover) give rise to 
functions / that cannot be well-approximated (in a mutliplicative sense) by any submodular function, but stiU 



admit good maximization algorithms by our results in Section 3 



1.1 Related Work 



Constrained submodular maximization problems have been very widely studied [ ]24[ , [llj , |29| , [g, ^ g3[]. However, 
as we mention above, the set cover and vertex cover functions are far from submodular. Interestingly, in a recent 
paper on testing submodularity [^], Seshadhri and Vondrak conjecture that the success of greedy maximization 
algorithms may depend on a more general property than submodularity; this work provides further corroboration 
for this, since we show that in our context online algorithms can serve as surrogates for submodularity. 

Feige et al. [|l^] first considered the A;-max-min set cover subject to = (^) (the "cardinality-constrained" case) — 
they gave an 0(log?Tilogn)-approximation algorithm for the problem with m sets and n elements. They also 



showed an ^( 



log m 



log log m hardness of approximation for A;-max-min (and A; -robust) set cover. The results in this paper 
build upon ideas in [[T0|], by handling more general covering problems and sets Vl. To the best of our knowledge, 
none of the A:-max-min problems other than min-cut have been studied earlier; note that the min-cut function is 
submodular; and hence the associated max-min problem can be solved using submodular maximization. 



The study of approximation algorithms for robust optimization was initiated by Dhamdhere et al. [|8[ |14[]: they 
study the case when the scenarios were explicitly listed, and gave constant-factor approximations for several com- 
binatorial optimization problems. Again, the model with implicitly specified (and exponentially many) scenarios 
was considered in Feige et al. [ |l0|] , where they gave an 0(log m log n)-approximation for robust set cover in the 
cardinality-constrained case 17 = ( , 



^ j . Khandekar et al. [ ]22[ ] noted that the techniques of | [10| ] did not seem to imply 
good results for Steiner tree, and developed new constant-factor approximations for /c-robust versions of Steiner 
tree, Steiner forest on trees and facility location, again for the cardinality-constrained case. We investigate many 
of these problems in the cardinality-constrained case of both the max-min and robust models in the companion 
paper [|T5|], and obtain approximation ratios better than the online competitive factors. On the other hand, the goal 
in this paper is to give a framework for robust and max-min optimization under general uncertainty sets. 



2 Preliminaries 



2.1 Deterministic covering problems 

A covering problem 11 has a ground-set E of elements with costs c : E ^ M+, and n covering requirements (often 
called demands or clients), where the solutions to the i-th requirement is specified — ^possibly implicitly — by a 
family IZi C 2^ which is upwards closed (since this is a covering problem). Requirement i is satisfied by solution 
/" C £' iff G 7?.j. The covering problem 11 = {E, c, {Tli}^^^) involves computing a solution F Q E satisfying 
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all n requirements and having minimum cost X^ggj- Cg. E.g., in set cover, "requirements" are items to be covered, 
and "elements" are sets to cover them with. In Steiner tree, requirements are terminals to connect to the root and 
elements are the edges; in multicut, requirements are terminal pairs to be separated, and elements are edges to be 
cut. 

The min-cost covering function associated with 11 is: 



fn{S) := min 




2.2 Max-min problems 

Given a covering problem IT and a collection U C 21"] of "independent sets", the max-min problem MaxMin(n) 
involves finding a set a; € Q for which the cost of the min-cost solution to a; is maximized, 

max /n(t^). 



2.3 Robust covering problems 

This problem, denoted Robust(n), is a two-stage optimization problem, where elements are possibly bought in the 
first stage (at the given cost) or the second stage (at cost A times higher). In the second stage, some subset a; C [n] 
of requirements (also called a scenario) materializes, and the elements bought in both stages must collectively 
satisfy each requirement in uj. Formally, the input to problem Robust(n) consists of (a) the covering problem 
n = {E, c, {TZi}'2^]) as above, (b) an uncertainty set C 21"] of scenarios (possibly implicitly given), and (c) an 
inflation parameter A > 1. A feasible solution to Robust(n) is a set of first stage elements Eq C E (bought 
without knowledge of the scenario), along with an augmentation algorithm that given any u £ ^} outputs E^ C E 
such that Eq U E^ satisfies all requirements in uj. The objective function is to minimize: 

c{Eq) + A • max c{Ei^) . 

Given such a solution, c{Eo) is called the first-stage cost and max^^gQ c{E^) is the second-stage cost. 

Note that by setting A = 1 in any robust covering problem, the optimal value of the robust problem equals that of 
its corresponding max-min problem. 

As in [|^], our algorithms for robust covering problems are based on the following type of guarantee. In [15] these 
were stated for A; -robust uncertainty sets, but they immediately extend to arbitrary uncertainty sets. 

Definition 2.1 An algorithm is (ai, a2, /3)-discriminating iff given as input any instance o/ Robust(n) and a 
threshold T, the algorithm outputs (i) a set ^ E, and (ii) an algorithm Augment^ : — ?• 2^, such that: 

A. For every scenario D £ Q, 

(i) the elements in U Augmentrp{D) satisfy all requirements in D, and 

(ii) the resulting augmentation cost c (Augment2-(D)) < /3 ■ T. 

B. Let <I>* and T* (respectively) denote the first-stage and second-stage cost of an optimal solution to the 
Robust(n) instance. If the threshold T >T* then the first stage cost c{^t) < ai • <I>* + 02 • T*. 

Lemma 2.2 ([jl|]) If there is an (ai, 02, /3) -discriminating algorithm for a robust covering problem Robust(n), 
then for every e > there is a ((1 + e) • max {ai, /5 + -approximation algorithm for Robust(n). 
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2.4 Desirable Properties of the Covering Problem 

We now formalize certain properties of the covering problem 11 = {E,c, {TZi}^^i) that are useful in obtaining 
our results. Given a partial solution S Q E and a set X C [n] of requirements, any set Ex ^ E such that 
S U Ex £ TZi yi £ X is called an augmentation of S for requirements X. Given X, S, define the min-cost 
augmentation of S for requirements X as: 

OptAug(X I 5) := min{c(^x) \ Ex ^ E md S U Ex e 7^^, Vi G X}. 



Also define Opt(X) := mm{c{Ex) \ Ex <Z E and Ex eni^i e X} = OptAug(X | 0), for any X C [n]. 
An easy consequence of the fact that costs are non-negative is the following: 

Property 2.3 (Monotonicity) For any requirements X Y (1 [n] and any solution S C E, OptAug(X|S') < 
OptAug(y|S'). Similarly, for any X C [n] and solutions T C S Q E, OptAug(X | S) < OptAug(X | T). 

From the definition of coverage of requirements, we obtain: 

Property 2.4 (Subadditivity) For any two subsets of requirements X,Y Q [n] and any partial solution S Q E, 
we have OptAug(X | S) + OptAug(y | S) > OptAug(X UY \ S). 

To see this property: if Tx ^ E and Ty C i? are solutions con^esponding to OptAug(X | 5) and OptAug(y | 5) 
respectively, then Tx U Ty U S covers requirements X U Y; so OptAug(X U Y \ S) < c{Tx U JV) < 
c[Tx) + c(JV) = OptAug(X I 5) + OptAug(y | 5). 

We assume two additional properties of the covering problem: 

Property 2.5 (Offline Algorithm) There is an Ooff -approximation (offline) algorithm for the covering problem 
OptAug(X I S), for any S Q E and X C [n]. 

Property 2.6 (Online Algorithm) There is a polynomial-time deterministic Oon-competitive algorithm for the on- 
line version of II = {E, c, {7?..j},"^]^). 

2.5 Models of Downward- Closed Families 

All covering functions we deal with are monotone non-decreasing. So we may assume WLOG that the collection 
Q in both MaxMin(n) and Robust(n) is downwards-closed, i.e. A C B and B e =^ A e ^l. In this paper 
we consider the following well-studied classes: 

Definition 2.7 (p-system) A downward-closed family Q C 2["1 is called a p-system iff: 



< p, for each A CI [n], 



where C 17 denotes the collection of maximal subsets in Sets in are called independent sets. We assume 
access to a membership-oracle, that given any subset I C [n] returns whether or not / € 0. 

Definition 2.8 (g-knapsack) Given q non-negative vectors , . . . ,w'' : [n] M4. and capacities bi, . . . ,bq € 
M+, the q-knapsack constrained family is: 



AC[n]: ^w^{e) < bj, for all j e [q]\ . 

eeA ) 
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These constraints model a rich class of downward-closed families. Some interesting special cases of p-systems are 



p-matroid intersection [ ]26| ] and p-set packing [ ]18[ , ^J; see the appendix in [g] for more discussion on p-systems. 
Jenkyns pi] ] showed that the natural greedy algorithm is a p-approximation for maximizing linear functions over 
p-systems, which is the best known result. Maximizing a linear function over g-knapsack constraints is the well- 



studied class of packing integer programs (PIPs), eg. [28]. Again, the greedy algorithm is known to achieve an 



0((/)-approximation ratio. When the number of constraints q is constant, there is a PTAS 

3 Algorithms for Max-Min Optimization 

In this section we give approximation algorithms for constrained max-min optimization, i.e. Problem (Max-/) 
where / is given by some underlying covering problem and Q. is given by some p-system and g-knapsack. We first 
consider the case when is a p-system. Then we show that any knapsack constraint can be reduced to a 1-system 
(specifically a partition matroid) in a black-box fashion; this enables us to obtain an algorithm for Q. being the 



intersection of a p-system and (/-knapsack. The results of this section assume Properties |24| and 
3.1 Algorithm for |}-System Constraints 

The algorithm given below is a greedy algorithm, however it is relative to the objective of the online algorithm Ao 
from Property rather than the (approximate) function value itself. 



Algorithm 1 Algorithm for MaxMin(n) under p-system 

1: input: the covering instance IT that defines / and p-system Q.. 

2: let cun^ent scenario Aq ^ 0, counter i 0, input sequence cr (). 

3: while (3e G [n] \ Ai such that Ai U {e} € ^) do 

4: Oj+i ^ argmax {c{Aon{(y ° e)) — c{Aon{o')) : e ^ [n\\Ai and Ai U {e} G Q,}. 
5: let cr ^ cr o Oj+i, Aj+i ^ U {aj+i}, i ^ i + 1. 

6: end while 

7: let D ^ Aihe the independent set constructed by the above loop. 

8: output solution D. 



Theorem 3.1 Assuming Properties 2.4 and 2.6 there is a ((p + 1) aon)-approximation algorithm for MaxMin(n) 
under p-sy stems. 

Proof: The proof of this lemma closely follows that in |^] for submodular maximization over a p-system. We use 
slightly more notation that necessary since this proof will be used in the next section as well. 

Suppose that the algorithm performed k iterations; let D = {ai, • • • , Cfc} be the ordered set of elements added by 
the algorithm. Define a = (), Go := 0, and Gi := Aon{o' o ai • • • Oj) for each i € [k]. Note that Go ^ Gi C • • • C 
Gfc. It suffices to show that: 

OptAug(5 I Go) < (p + 1) • c(Gfe \ Go) for every S € 0. (3.1) 

This would imply Opt(i?) < (p + 1) • c(Gfc) < (p + 1) Oon • Opt(Z)) for every B ^ Q., and hence that D is the 
desired approximation. 

We use the following claim proved in Appendix B (this claim relies on the properties of a p-system). 
Claim 3.2 ([^) For any B ^ Q, there is a partition o/i? such that for all i G [k], 

1- \Bi\ < p, and 

2. For every e € Bi, we have {ai, • • • ,aj_i}|J{e} G ft. 



6 



For any sequence vr of requirements and any e € [n] define Aug(e;7r) := c{Aoni'^ ° ^)) ~ c{Aoni'^))- Note tfiat 
this function depends on tiie particular online algorithm. From the second condition in Claim it follows that 
each element of Bi was a feasible augmentation to {ai, . . . , Oj-i} in the i^^ iteration of the while loop. By the 
greedy choice, 

c{Gi) — c{Gi-i) = Aug(aj; (J o ai • • • Oj-i) > max Aug(e; a o ai • • • aj_i) 

eeBi 

- 7^ yZ ^"'Sje; cr o oi • • • aj-i) 

> ^ J] OptAug({e} I (3.2) 

> ^ •OptAug(B, I (3.3) 

> - •OptAug(Bi I (3.4) 
P 



Above equation < p2 ) is by the definition of Gi-i = Aon{o' o ai ■ ■ ■ at-i), equation ( [3.3[ ) uses the subadditivity 



Property [2.4 and ( |3.4| ) is by the first condition in Claim | 
Summing over all iterations i G [k], we obtain: 

c(Gfc) -c(Go) = ^Aug(ai;(Toai...ai_i) > -^OptAug(Si | d^i) > -^OptAug(Bi | Gk) 

1=1 ^ i=l ^ i=l 

where the last inequality follows from monotonicity since C G^ for all i € [k]. 

Using subadditivity property 2.4| , we get c(Gfc) - c(Go) > J • OptAug(U,^iSi \ Gk) = J • OptAug(5 | Gu). 

Let J := argmin{c(J') | J' C and Gk U J' C Tig, Ve e 5}. i.e. OptAug(S | Gk) = c{J). Observe that 
J U {Gk \ Go) is a feasible augmentation to Go that covers requirements B. Thus, 

OptAug(i? j Go) < c( J) + c{Gk \ Go) = OptAug(i? | Gk) + c{Gk \ Go) < (p + 1) • c(G,. \ Gq). 

This completes the proof. ■ 

3.2 Reducing knapsack constraints to partition matroids 

In this subsection we show that every knapsack constraint can be reduced to a suitable collection of partition 
matroids. This property is then used to complete the algorithm for MaxMin(n) when is given by a p-system and 
a (/-knapsack. Observe that even a single knapsack constraint need not correspond exactly to a small p-system: eg. 
the knapsack with weights wi = 1 and W2 = w^, = ■ ■ ■ = Wn = ji, and capacity one is only an {n — 1) -system 
(since both {1} and {2, 3, • • • , n} we. maximal independent sets). However we show that any knapsack constraint 
can be approximately reduced to a partition matroid (which is a 1-system). The main idea in this reduction is an 
enumeration method from Chekuri and Khanna [^. 



Lemma 3.3 Given any knapsack constraint Wi ■ Xi < B and fixed < e < 1, there is a polynomial-time 
computable collection Vi, - ■ ■ , Vt ofT = vP^^I'^^) partition matroids such that: 



1. For every X G vJf^iVt, we have X^igx ^« ^ (1 + ' 

2. {X'^[n]\Y.^^^w^<B}<Z^J^{P,. 
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Proof: Let 5 = e/6 and /3 = ^. WLOG we assume that max"^^ Wi < B. Partition the groundset [n] into 



^ •= \ ioSi+S) ^ groups as follows. 



{i £[n]:wi<^} if k = 

{i € [n] : /3 • (1 + 6)''-^ < Wi < ^ ■ {1 + 5)''} if 1 < k < G 



Let T denote the number of non-negative integer partitions of \G/S] into G parts. Note that, 

T := (^^/'^^t ^ " ') < eM\G/6] +G-l)< nOW''\ 

We will define a collection of T partition matroids on [n], each over the partition {Sq, 5i, . . . , 5g}- For any integer 
partition r = {Uk}^^i of \G/5'\ (i.e. C/^ > are integers and t/fc = \G/5'\), define a partition matroid Vt 
that has bounds Nk{T) on each part Sk, where 

\ oo ifk = Q 

'''^'^'■=\ V§^\ ifl <k<G 

Clearly this collection can be constructed in polynomial time for fixed e. We now show that this collection of 
partition matroids satisfies the two properties in the lemma. 

(1) Consider any X C [n] that is feasible for some partition matroid, say Vr- The total weight of elements X n Sq 
is at most n ■ fi < 5 ■ B. For any group 1 < k < G, the weight of elements X n 5^ is at most: 

\X^Sk\-(i{l + 6f < Nkir) • /3 (1 + 5)'= < 5(1 + 5)iUk + 1) • | 
Hence the total weight of all elements in X is at most: 

6B + 6{l + S)^- (^Uk + G^ < 6B + 6{l + 6)^- (^j + l + G^ 

< 5B + 6{l + 6)^- (^j + 2G 

< 6B + {l + 6)-{B + 26B) 

< B + 66B. 

Above we use 6 < 1. Finally since 5 = e/6, we obtain the first condition. 

(2) Consider any Y C [n] that satisfies the knapsack constraint, i.e. Yli^Y ^* — ^- ^^^^ show that Y is 
feasible in Vr, for some integer partition r of as above. For each 1 < A; < G let denote the weight of 
elements in y n 5^, and C/fc be the unique integer that satisfies Uk ■ ^ < Qk < {U^ + f) • Define r to be the 
integer partition {C/fe}^^i. We have J2k < G/5, which follows from the fact B >Y,kQk > ^ ■ Y^k ^k- By 
increasing f/^s ai^bitrarily so that they total to we obtain a feasible integer partition r. We now claim that 
Y is feasible for Vr- Since each element of Sk has weight at least /3 • (1 + (5)^~^, we have 

\YnS\< < (f^fc + l)-^^/^ _ n-iUk + l) 



/3 (1 + - (1 + 5)*^-! • 5B/n G • (1 + 5)^-i 

niUk + 
G-(l+5)* 



Since \Y n Sk\ is integral, we obtain \Y n Sk\ < [t^tt^^^I < Nkir). Thus we obtain the second condition. 
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3.3 Algorithm for p-System and g-Knapsack Constraints 



Here we consider MaxMin(n) when O is the intersection of p-system A4 and a g-knapsack (as in Definition 2.8). 



The idea is to reduce the g-knapsack to a single knapsack (losing factor q), then use Lemma ^ to reduce the 



knapsack to a 1-system, and finally apply Theorem 3.1 on the resulting p + 1 system. Details appear- below. 

By scaling weights in the knapsack constraints, we may assume WLOG that each knapsack has capacity exactly 
one; let w^, • • • ,w'^ denote the weights in the q knapsack constraints. We also assume WLOG that each singleton 
element satisfies the g-knapsack; otherwise such elements can be dropped from the groundset. 

Algorithm 2 Algorithm for MaxMin(n) under p-system and q-knapsack 



Approximate the g-knapsack by a single knapsack with weights Yl'j=i ^^'^ capacity q; applying Lemma 3.3 
with e = ^ on this knapsack, let {'Pj}j'^i denote the resulting partition matroids (note L = n*^^^)). 
For each j € [L], define Sj := A4f] Vj; note that each Sj is a + 1) -system. 



Run the algorithm from Theorem ^3] under each p + 1 system {T,j}j^^ to obtain solutions {Ej G Sj}j= 
Let J* ^ argmax^^^ c{Aon{Ej)). 



Partition Ej* into {uji}^^^ such that each Ui € Q,, as per Claim 3^ 



Output LOi* where i* ^ arg max^^^^ c {Aof f{uJi))- Here we use the offline algorithm from Property 2^ 



We now establish the approximation ratio of this algorithm. 
Claim 3.4 U C uf^^T.j. 

Proof: For any a; € 0, we have J2eGuj ^ 1 for ^ ^ W\- Hence X^gg^ S?=i w^{&) < 9> i-C- it satisfies the 



combined knapsack constraint. Now by Lemma 33 (2), we obtain uj G UjLi ^j- Finally, since u; G ^2 C A^, we 
have ijj G U^L^Sj. ■ 

Claim 3.5 For each r G U^L^Sj there exists a collection such that r = IJ^=i^ ^f-' ^ Jl/or all 

i [3q + 1]. Furthermore, this is computable in polynomial time. 

Proof: Consider any r G H := U^^^^Sj. Note that r G A^, so any subset of r is also in M (which is downwards- 
closed). We will show that there is a partition of r into {i^^j^^^ such that each ojn satisfies the q-knapsack. This 



suffices to prove the claim. Since r G |J_;=i^i' by Lemma 3.3 (1) it follows that ^eer X^i=i ^*(^) — I*?- 
Starting with the trivial partition of r into singleton elements, greedily merge parts as long as each part satisfies the 
g-knapsack, until no further merge is possible. (Note that the trivial partition is indeed feasible since each element 
satisfies the g-knapsack.) Let {uj^Y^^^ denote the parts in the final partition; we will show r < 3g + 1 which would 
prove the claim. Consider forming [r/2j pairs from {(jJiY^^i arbitrarily. Observe that for any pair {w, w'}, it must 
be that w U w' violates some knapsack; so '^Zeewiju' Si=i > 1- Thus X^gg^ I^i=i > k/2j- On the 

other hand, YleSiT Ylt=i w^ie) < |g, which implies r < 3g + 2. ■ 



Theorem 3.6 Assuming Properties |2.4 |2. j| and there is an 0{{p + 1) {q + 1) Ooff aon) -approximation algo- 



rithm for MaxMin(n) under a p-system and q-knapsack constraint. 

we 



Proof: Let Optj denote the optimal value of MaxMin(n) under p+1 system Sj, for each j G [L]. ByClaim3.4' 
have max^L]^ ^P^j — ^P^' the optimal value of MaxMin(n) under il. Observe that Theorem |3.1| actually implies 
c{Aon{Ej)) > ^ • Optj for each j G [q]. Thus c{Aon{Ej*)) > ^ • Opt; hence Opt{Ej*) > ^^^^^ ■ Opt. 
Now consider the partition {ooi}^^^ of Ej* from Claim |3.5[ By the subadditivity property, Yli^^ Opt(a;i) > 
Opt(£'j*); i.e. there is some i' G [3g+ 1] with Opt(a;j') > - — (p^2)(3g+i) ' ^P^^ Thus the i* found using the offline 
algorithm (Property IJ) satisfies Opt(wi.) > a,ff (p+2)(3<?+i) ' ^P*- ■ 
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Remark: We can obtain a better approximation guarantee of 0{{p + 1) {q + 1) Oon) in Theorem |3!6| using ran- 
domization. This algorithm is same as Algorithm 2, except for the last step, where we output uj£ for £ £ [3q + 1] 
chosen uniformly at random. From the above proof of Theorem it follows that: 

^^^^ i^i 3g + l Oon (P + 2)(3g + 1) 

4 General Framework for Robust Covering Problems 

In this section we present an abstract framework for robust covering problems under any uncertainty set Q., as long 
as we are given access to offline, online and max-min algorithms for the base covering problem. Formally, this 



requires Properties |2.5| , |2.q and the following additional property (recall the notation from Section | 



Property 4.1 (Max-Min Algorithm) There is an amm-cippfoximation algorithm for the max-min problem: given 
input S C E, MaxMin(S') := maxxen min{c(^) \ SU Ae Ri, Vi € X}. 

Theorem 4.2 Under ^roperties 2.4\ |25| ^^and^^ there is an 0{aof{ • Oon ' cxiYiiYi^-approximation algorithm for 
the robust covering problem Robust(n) = {E, c, 57, A). 

Proof: The algorithm proceeds as follows. 

Algorithm 3 Algorithm Robust-with-General-Uncertainty-Sets 



input: the Robust(n) instance and threshold T. 

let counter t 0, initial online algorithm's input a = {), initial online solution Fq ^ %. 
repeat 

set t ^ t + 1. 

let Et C [n] be the scenario returned by the algorithm of Property 4.1 on MaxMin(Ff_i^ 



let o" ^ (T o Et, and Ft ^on(c) be the current online solution, 
until c(Ft) -c(Ft_i) < 2aon -T 
set T ^ t — 1. 

output first-stage solution <I>r := Fr- 

output second-stage solution Augment^ where for any a; C [n], Augment'r(c<j) is the solution of the offline 
algorithm ( [Property 2.5 ) for the problem OptAug((xi | '^t)- 



As always, let ^* C. E denote the optimal first stage solution (and its cost), and T* the optimal second-stage cost; 
so the optimal value is <l>* + A • T*. We prove the performance guarantee using the following claims. 

Claim 4.3 (General 2nd stage) For any T > and X ^Q., elements U Augment jn(X) satisfy all the require- 
ments in X, and c(Augmentj'(X)) < 2aoff • amm • OLon ■ T. 



Proof: It is clear that U Augment2-(X) satisfy all requirements in X. By the choice of set -Er+i in hne 5 
of the last iteration, for any X G O we have: 

OptAug(X I Fr) < Omm ' OptAug(^^+i | Fr) < a^^ ■ (c(F^+i) - c{Fr)) < 2a^^ -a^n-T 

The first inequality is by [Property 4. 1[ t he second inequahty uses the fact that ^,-+1 5 Fr (since we use 
an online algorithm to augment in [line i ),0 and the last inequality follows from the termination condition in 
Line 7[ Finally, since Augment2-(X) is an aoff-^pproximation to OptAug(X | Fr), we obtain the claim. ■ 



^This is the technical reason we need an online algorithm. If instead we had used an offline algorithm to compute Ft in step |g then 
Ft 2 Ft-i and we could not upper bound the augmentation cost OptAug(i5t | Ft-\) by c{Ft) — c{Ft-\). 
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Claim 4.4 Opt(Ut<^^() < r • T* + 



Proof: Since each Et ^ Q, (these are solutions to MaxMin), the bound on the second-stage optimal cost gives 
OptAug(Et I $*) < T* for all t < r. By subadditivity ( property 2.4| ) we have OptAug{Ut<rEt \ $*) < 
T ■ T*, which immediately implies the claim. ■ 

Claim 4.5 Opt{Ut<rEt) > ^ ■ c{Fr). 



Proof: Directly from the competitiveness of the online algorithm in Property 2.6. ■ 

Claim 4.6 (General 1st stage) IfT > T* then c(^>t) = c(F^) < 2 Oon • 

Proof: We hav e c(F^) = Y.t=i - c(Ft-i)] > 2aonT • T > 2 a^„T ■ T* by the choice in Step (0). 

Combined with [Claim 43| , we have Opt(Ut<r£'t) > 2t • T* . Now using [Claim 4.4 we have t-T* < and 
hence Opt(Uj<r-E't) < 2 • Finally using [Claim 4.5[ , we obtain c(F^) < 2aon • ■ 



Claim 4.3[ and [Claim 4.^ imply that the above algorithm is a (2aorn 0, 2Q!mm"onttoff)-discriminating algorithm 
for the robust problem Robust(n) 



E, c, {-Rj}"^^, f], A). Now using Lemma 2.2 we obtain the theorem. 



Explicit uncertainty sets An easy consequence of [Theorem 4.2[ is for the explicit scenario model of robust 
covering problems 14 ], where Q, is specified as a list of possible scenarios. In this case, the MaxMin problem can 
be solved using the Ooff-approximation algorithm from Property 2.5 which implies an 0(aQffaon)-approximation 
for the robust version. In fact, we can do slightly better — observing that in this case, the algorithm for second- 
stage augmentation is the same as the Max-Min algorithm, we obtain an O(aoff ■ aon) -approximation algorithm 
for robust covering with explicit scenarios. As an application of this result, we obtain an 0(log n) approximation 
for robust Steiner forest with explicit scenarios, which is the best known result for this problem. 

5 Robust Covering under ]?-System and g-Knapsack Uncertainty Sets 

Recall that any uncertainty set U for a robust covering problem can be assumed WLOG to be downward-closed, 
i.e. X € and Y C X implies y € il. Eg., in the A;-robust model Q, = {S <Z [n] : \S\ < k}. Hence it is 
of interest to obtain good approximation algorithms for robust covering when is specified by means of general 
models for downward-closed families. In this section, we consider the two well-studied models of p-systems and 



g-knapsacks (Definitions 2.7 and 2.8). 

The result of this section says the following: if we can solve both the offline and online versions of a covering 
problem well, we get good algorithms for Robust(n) under uncertainty sets given by the intersection of p-systems 
and q-knapsack constraints. Naturally, the performance depends on p and q; we note that this is unavoidable due 



to complexity considerations. Based on Theorem it suffices to give an approximation algorithm for the max- 
min problem under p-systems and g-knapsack constraints; so Theorem [s]^ combined with Theorem implies an 
O {{p + l){q + 1) a^ff) -approximation ratio. However, we can obtain a better guarantee by considering the 
algorithm for Robust(n) directly. Formally we show that: 



Theorem 5.1 Under properties 2~4 [2.3] and 2.6 , the robust covering problem Robust(n)(£^, c, {T^i}™ ^, 0, A) 
admits an O {{p + 1) ■ {q + 1) ■ Ooff • Uon) -approximation guarantee when is given by the intersection of a p- 
system and q-knapsack constraints. 



The outUne of the proof is same as for Theorem We first consider the case when the uncertainty set is a p- 
system ( [subsection 5.1 ); then using the reduction in Lemma 33 we solve a suitable instance of Robust(n) under 
a (p + 1) -system uncertainty set. 
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5.1 p-System Uncertainty Sets 



In this subsection, we consider Robust(n) when the uncertainty set U is some p-system. The algorithm is a combi- 



nation of the ones in Theorem ^ and Theorem |3.1| . We start with an empty solution, and use the online algorithm 
to greedily try and build a scenario of large cost. If we do find a "violated" scenario which is unhappy with the 
current solution, we augment our current solution to handle this scenario (again using the online algorithm), and 
continue. The algorithm is given as Algorithm 4 below. 

Algorithm 4 Algorithm Robust-with-p-system-Uncertainty-Sets 
1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 
13 
14 
15 



input: the Robust(n) instance and bound T. 

let counter t 0, initial online algorithm's input a = {), initial online solution Fq ^ 0. 
repeat 

set t ^ t + 1. 

let current scenario Aq -i— 0, counter i ^ 0. 
while (3e G [n] \ A\ such that A\ U {e} G 17) do 

Oj+i ^ arg max{c(>lon(o' ° e)) — c(^on(c)) I e G [n] \ and Ai U {e} G Vt\. 
let cr ^ cr o ttj+i, A\j^i ^ ^* U {aj+i},i i + 1. 
end while 

let Et <r- A\ be the scenario constructed by the above loop, 
let Ft ^ Aon{(^) be the current online solution, 
until c(Ft) -c(Ft_i) < 2aon -T 
set r ^ t - 1. 

output first-stage solution '■= F^. 

output second-stage solution Augmentj^ where for any i^i C [n], IKugmer\tj,{ijj) is the solution of the offline 



algorithm (Property |2.5| ) for the problem OptAug(a; | ^t)- 



We first prove a useful lemma about the behavior of the while loop. 

Lemma 5.2 (Max-Min Lemma) For any iteration t of the repeat loop, the scenario Et & Q has the property that 
for any other scenario B G Jl, OptAug(i? | Ft^i) < (p + 1) • c{Ft \ Ft^i). 



Proof: The proof is almost identical to that of Theorem p.l| . 

Consider any iteration t of the repeat loop in Algorithm 4 that starts with a sequence a of elements (that have been 
fed to the online algorithm Aon)- Let A = {ai, • • • , a^} be the ordered set of elements added by the algorithm in 
this iteration. Define Go := Aon{<^), and Gi := ^on(c o ai • • • Oj) for each i G [A;]. Note that = Gq and 
Ft = Gk, and Go C Gi C • • • C G^. It suffices to show that OptAug(B | Go) < (p + l) ■ c{Gk \ Go) for every 



B G Q. But this is precisely Equation (3.1) from the proof of Theorem |3.l| 



Corollary 5.3 (Second Stage) For any T > and B £ U, elements U Augmenty(-B) satisfy all the require- 
ments in B, and c{fKugmentrp[B)) < 2aoff • Oon ■ (p + 1) ' T. 

Proof: Observe that = F^- = Aon{cr), so the first part of the corollary follows from the definition of AugmentT^. 
By |Lemma 5.2 and the termination condition on line 12 , we have OptAug(i? | Fr) < {p+2)-{c{Fr+i) — c{Fr)) < 



2(p+2)aon T. Now Property 2.5 guarantees that the solution Augment2^(i3) found by this approximation algorithm 



has cost at most 2aoff • aon • + 2) T. ■ 

It just remains to bound the cost of the first-stage solution Ft-. Below $* denotes the optimal first-stage solution 
(and its cost); and T* is the optimal second-stage cost. 

Lemma 5.4 (First Stage) IfT > T* then c{^t) = c{Fr) < 2ao„ ■ 

Proof: For any set X C [n] of requirements let Opt(X) denote the minimum cost to satisfy X. Firstly, observe 
that Opt(Ut<T-i^'j) < r • T* + <I>*. This follows from the fact that each of the r scenarios Et are in Q,, so the bound 
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on the second-stage optimal cost gives OptAug(£'t | <!>*) < T* for all t < r. By subadditivity ( Assumption 2.4 ) 



we have OptAug(Ut<T-i^'t j < t • T* , which immediately implies the inequality. Now, we claim that 

0^t{yJt<r Et) > ^ ■ c{Fr) > ^ ■ 2ao„T ■T* = 2t-T*. (5.5) 



The first inequality follows directly from the competitiveness of the online algorithm in [Assumption 2.6| . For the 
second inequality, we have c{Fr) = J2t=i ~ > 2aonT • T > 2aonT ■ T* by the terminal condition 

in [Step 12 . Putting the upper and lower bounds on Opt(Ut<T-E'f) together, we have r • T* < <!>*, and hence 



Opt(Ut<T-i?t) < 2 • ^>*. Using the competitiveness of the online algorithm again, we obtain c{Fr ) < 2aon • • 
From [Corollary 5.3 and ^!.emma 5^4 , it follows that our algorithm is (2aon, 0, 2aoff aon • (p + l))-discriminating 



(cf. Definition pTl] ) to Robust(n). Thus we obtain Theorem 5.1 for the case q = 0. 
5.2 Algorithm for p- Systems anrf g-Knapsacks 

Here we consider Robust(n) when the uncertainty set Q is the intersection of p-system A4 and a g-knapsack. 



The algorithm is similar to that in Subsection Again, by scaling weights in the knapsack constraints, we 
may assume WLOG that each knapsack has capacity exactly one; let w^, - ■ ■ ,w'^ denote the weights in the q 
knapsack constraints. We also assume WLOG that each singleton element satisfies the g-knapsack. The algorithm 
for Robust(n) under Q works as follows. 

Algorithm 5 Algorithm Robust with p-system and g-knapsack Uncertainty Set 
1: Consider a modified uncertainty set Q' that is given by the intersection of M. and the single knapsack with 
weight-vector Yl'j=i '^^ ^^^^ capacity q. 



2: Applying the algorithm in Lemma to this single knapsack with e = 1, let {Vj}j^i denote the resulting 

partition matroids (note L = n'^^^^). 
3: For each j € [L], define uncertainty-set T,j := 7W P| Vj; note that each Sj is a (p + l)-system. 
4: Let S ^ U^^^Sj. Solve Robust(n) under E using the algorithm of Theorem [ 



Recall Claims 3.4 and 3.5 which hold here as well. 



Lemma 5.5 Any a-approximate solution to Robust(n) under S is a {3q+l)a-approximate solution to Robust(n) 
under uncertainty-set Vl. 

Proof: Consider the optimal first-stage solution <I>* to Robust(n) under Q., let T* denote the optimal second-stage 
cost and Opt the optimal value. Let r G S be any scenario, with partition {uji}\'^^ given by Claim Using the 
subadditivity Property we have OptAug(r|<l>*) < Yl^t^i OptAug(w£|$*) < (3g + 1) • T*. Thus the objective 



value of for Robust(n) under S is at most c(^>*) + \ ■ {2>q + l)T* < (3g + 1) • Opt. 



Claim 3.4 implies that for any solution, the objective value of Robust(n) under Q, is at most that of Robust(n) 



under S. Thus the lemma follows. ■ 
For solving Robust(n) under S, note that although S itself is not any p'-system, it is the union of polynomially- 



many {p + 1) -systems. We show below that a simple extension of the algorithm in Subsection 5_A also works for 
unions of p-systems; this would solve Robust(n) under S. 

Theorem 5.6 There is an 0{{p + 1) Ooff aon)-<^PP^oximation for Robust(n) when the uncertainty set is given by 
the union of polynomially-many p-sy stems. 

Proof: Let S = uj'^j^Sj denote the uncertainty set where each Sj is ap-system. The algorithm for Robust(n) un- 
der S is just Algorithm 4 where we replace the body of the repeat-loop (ie. lines 4- 1 1) by : 

1: sett ^ t + 1. 

2: for(j G [L])do 
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let current scenario Aj ^ 0, 

while (3e G [n] \ Aj such that Aj U {e} € do 

e* ^ argmax{c(^o„((T o o e)) — c{Aon{<^ ° ^j)) I e S [n] \ Aj and U {e} G $7}. 
^ U {e*}. 
end while 

Let Aj ^ c{Aon{o- oAj))- c{Aon{(T))- 
end for 

let j* ^ argmax{Aj | j G [L]}, and ^ Aj*. 

let a a o Et and ^ A.on(c) be the current online solution. 



Consider any iteration t of the repeat loop. By Lemma ^ applied to each p-system Sj, 
Claim 5.7 For each j G [L], we have OptAug(-B|Ft_i) < (p + 1) • Ajfor every B G Sj. 

By the choice of scenario Et and since S = Uj=i ^j' we obtain: 

Claim 5.8 For any iteration t of the repeat loop and any B & T,, OptAug(i?jFf_i) < (p + 1) • c{Ft \ -Fj_i] 



Based on these claims and proofs identical to Corollary and Lemma Q^, we obtain the same bounds on the first 
and second stage costs of the final solution Ft-. Thus our algorithm is (2aoni 0, 2aoff aon ■ {p + l))-discriminating, 



which by Lemma implies the theorem. 



Finally, combining Lemma |5^ and Theorem |5^ we obtain Theorem |5J . 

Remark: In Theorem 5.1 , the dependence on the number of constraints describing the uncertainty set Q, is in- 
evitable (under some complexity assumptions). Consider a very special case of the robust covering problem on 
ground-set E, requirements E (where i G ii^ is satisfied iff the solution contains i), a unit cost function on E, 
inflation parameter A = 1. The uncertainty set Q is given by the intersection of p different cardinality constraints 
coming from some set packing instance on E. In this case, the optimal value of the robust covering problem is 



exactly the optimal value of the set packing instance. The hai^dness result from Hastad [ ]17[ ] now implies that this 
robust covering problem is $7(^2"'=) hard to approximate. We note that this hardness applies only to algorithms 
having running time that is sub-exponential in both \E\ and p; this is indeed the case for our algorithm. 

Results for p-System and g-Knapsack Uncertainty Sets. We now list some specific results for robust covering 



under uncertainty sets described by p-systems and knapsack constraints; these follow directly from [Theorem 5.1 
using known offline and (deterministic) online algorithms for the relevant problems. 



Problem 


Offline ratio 


Online ratio 


p-system, g-knapsack Robust 


Set Cover 


0(log m) 


0(log m • logn) [ 






pq ■ log^ m ■ log n 


Steiner Tree/Forest 


2 |1, 13] 


0(log7i) [19, B] 


pq ■ log n 


Minimum Cut 


1 


0{log'^ n ■ log logn) [ 


3 


16 


] 


pq ■ log'^ n ■ log log n 


Multicut 


log n [12] 


0(log'^ n ■ log logn) [ 


3 


16 


] 


pq ■ log n ■ log log n 



6 Non-Submodularity of Some Covering Functions 

In this section we show that some natural covering functions ai^e not even approximately submodular. Let / : 
2^ — E>o be any monotone subadditive function. We say that / is a-approximately submodular iff there exists a 
submodular function g : 2^ ^ R>o with g{S) < f{S) < a ■ g{S) for all S C [/. 



Consider the min-set-cover function, fsc{S) = minimum number of sets required to cover elements S. 
Proposition 6.1 Tlw min-set-covering function is not o{n) -approximately submodular 

Proof: The proof follows from the lower bound on budget-balance for cross-monotone cost allocations. Immorlica 



et al. [20] showed that there is no o(77,)-approximately budget-balanced cross-monotone cost allocation for the set- 



cover game. On the other hand it is known (see Chapter 15.4.1 in [|25|]) that any submodular-cost game admits 
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a budget-balanced cross-monotone cost allocation. This also implies that any a-approximately submodular cost 
function (non-negative) admits an a-approximate budget-balanced cross-monotone cost allocation. Thus the min- 
set-covering function can not be o(n)-approximately submodular. ■ 

Similarly, for minimum multicut {fMMc{S) = minimum cost cut separating the pairs in S), 
Proposition 6.2 The min-multicut function is not o{ti}/^) -approximately submodular. 

Proof: This uses the result that the vertex-cover game does not admit o(n^/^)-approximately budget-balanced 
cross-monotone cost allocations [|^]. Since multicut (even on a stai^ graph) contains the vertex-cover problem, the 
proposition follows. ■ 

On the other hand, some other covering functions are indeed approximately submodular. 

• The minimum-cut function (fMc{S) = minimum cost cut separating vertices 5* from the root) is in fact 
submodular due to submodularity of cuts in graphs. 

• The min-Steiner-tree (fsriS) = minimum length tree that connects vertices S to the root) and min-Steiner- 
forest ifsF{S) = minimum length forest connecting the pairs in S) functions are O (log n) -approximately 
submodular. When the underlying metric is a tree, these functions are submodular — in this case they reduce 
to weighted coverage functions. Using probabilistic approximation of general metrics by trees, we can 
write g{S) = Ex^Tif'^ (S)] where T is the distribution on dominating tree-metrics (from [Q]) and 

is the Steiner-tree/Steiner-forest function on tree T. Clearly g is submodular. Since there exists T that 
approximates distances in the original metric within factor O(logn) |^, it follows that g also O(logn)- 
approximates fsr (resp. fsp)- 

While approximate submodularity of the covering problem 11 (eg. minimum-cut or Steiner-tree) yields direct 
approximation algorithms for MaxMin(n), it is unclear whether they help in solving Robust(n) (even under 
cardinality-constrained uncertainty sets [|l^]). On the other hand, the online-algorithms based approach in this 
paper solves both MaxMin(n) and Robust(n), for uncertainty sets from p-systems and g-knapsacks. 
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